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ABSTRACT ' 
One of a series of sixteen knowledge transformaticn 
papers, this paper examines the advantages and disadvantages of 
lergitudinal studies as a method for evaluating vocational prcgrarms. 
First, longitudinal methods are defined for the differences ktetween 
them and crose-sectional studies are established. The results of a 
literature search conducted on the ERIC database are provided, ieee 
showing that eighteen studies relevant to vocational educaticn used 
longitudinal methods. Then, the importance of lengitudinal data is. 
emphasized because of its role in studying the relationships’ tetween 
vocational program practices and student develcrpment. In the next 
section, ways to implement longitudinal studies are discussed. The 
data requirements are found to include input internation on tiography 
and enrollment; process data, such as student progress and program 
characteristics; and output information on termination, initial 
placement, and follow-up. The conclusicn ackncwledges the problems 
asscciated with such studies to be the complicated precess of data 
collection, the length cf tine involved, and the lack of prototypes 
for vecaticnal educators to eOnaous References are cited at the end. 
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Now that gducators have \asen ‘asked to account for and justify vocational pro- 


educators have -ex- - os 


tional, programs--the longitudinal study, Some dxanples “of the applicadtjon of: noe 


“ longétudinal methods to ee educAgion are also- presented. 


4 series of 16 papers produced during the first year of the National Center's. 


knowledge transformation program. The 16 papers are concentrated in the four ° 


theme areas‘ emphasized under the National Center. contract: special needs sub- , 
populations,’ sex fairness, planning, and evaluation in vocational ‘edycation. ot a 

The review and synthesis of research in each‘topic area is intended to communi- ; 
‘vocational..educators, “ineluding administrators, researchers, federal agency” ae” 
jpereommeh, and rhe National Center staff: / _ 2 oo 
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INTRODUCTION | ant er es 3 ye _ 
i oo : ce ae i ; ; : * - 8 sate '  -* 


’ Now that cauestors hay) been asked ‘to account for and justify vocational pro- 


program could beydetermined informally, thensmore money resources would be 
ava¥lable for operating prpgrams._-This. situation is now cHdnging. Most voca- 
tional personnel would agtee that evaluation, which produces data\shich can be 


id future : 
” ba ° *v 


“shared with dec}sions makérs, is a necessary part of the present 
' fie ¥- be a 
. ' operation of a program, < 


8 
The question no longer js,. "Should ore evaluate?" ‘The qubstion is,’ "What types, ¢ 
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“it In general, longitudinal methods refer to those used to’ gdther information over : 
: , a period of time. However, much more precis definitions &Sre available,, Atcord- 

vy ing’ tokghe cyclopedia of Educational Evaluation, "In a longitudinal study, re- 

.| peated measurements ure any of the same subjects, usually'‘ayer a‘long period 


of time." (Anderson et ak 1975, p..229).. .The assumption in a ‘pure longitu- 
ed djnal evaluation is jthat efch of the measuras taken at different points in time 
-, + , will Be comparable,’ which tesults in the term "repeated jpeasurements:" Id fact, 
, _ it has been suggested that, in axder ‘for a/gtudy; to be aferuc longitudinal, study, 
gthe sume instrument-must be used ‘to gather ‘the information eaeh time, information 
: “is gathered.” Ns. Anderson. ante associates (1975) state» "Some purists argue, how- 
: . gver, that a true longitudjma® study cannot aoe changes in instrumeptation. .. ie 
road es hares successive al a (pis 231). = * _ 
_ Sh’ example of’ uspure Tongitudinal study in vocational education sul to fol- .= 
- -low up thes graduates oF a vogational fi ; nd fiye ; 
* Years after they graduate fromthe*phogram. The same follow-up instrument whut, _ 
' be uged so that the sume data would be gatheted each time. The, basic purpose’ ~ 
would be'to see What changes occurred after one, three, and five years. In this 
study, the same information would be, gathered from the same people each time wi€h 
the same instrimeht. {It would take a minimum of five years after the class grad- . 
. uated’ to, gather all of the information negessary-to determine what changes actu- + 
\ a? ua kty dic occur one,. three, ‘and five years after- graduation. « = * a 


ke a a : : 2 an 
te This bape of ‘study eS “contrasted With a. .. efoss-sectional Tidy, Ak cToss- j 
‘ sectiowal, study gathers the same information: from different a individ). r 
&£ _ uals who have been ‘sblected because, they represent different stages of develop- 
_ ment, The/data.from these different) groups are compared to determine what 
changes occur as people or programs progress through different stages of develop- 
-ment. For example; rather than waiting five years to eer the: information’ _ 
eon the giilidduates of the.shorticulture program, a group & ria that. grad- — 
» uated one ‘'yéar ago would be identified ,/ another esau that” gradugted three: 
hay ago would, be identified, and another group that. graduate #ive years ago 
' would be identified.’ ‘These individuals would be administeréd the same follow- 
ae instrument at the same .1 time and the- results would be compared to determine 
what changes, were experiehced: by graduates ¢ one, in and five years after 


Bala 7 ey ; 


1 
z 


~ . mheeelor aca a. io the longitudinal “study is that. che. ‘Same group is sur- 
’ ' veyed over different periods of time. The group is thé same -bécause the, data’ a 

‘are actually gathered from the same individuals each time. , A major disadvan- 
tage is that a lJongitudinail study requires a long period of time before all 
‘of the imfdrmation is gathered for analysis. and dgcision makings Many times 
program opegation decisions cannot wait thet Tong. Another disadvantage,/ par- 
ticularly if test data are being gathered, is that the same group of eo 
, see: the same instrument over and over again and may get higher scores as: time 
progeésses because of familiarity with “the, inst runoyt ae , 


# 


i 


es : . ; ‘ 
: the advantage of a cross- sectional study is that | it ofp be be er ahi a 
a shorter period of time.: All ‘of the information can be: gathéred at the same ~, 
ces in time because it. is gather€d- from different groups of | a “The ~ 


+ 


: inajor disadvantage, however, is that one must assume that the data gathered at: 

. the same time from different groups: of individuals who represent diff rent , 
eae stages of development are equivalent to data gathered from, the same group. of: “ 
Kr : ice at the same ataeee of development . Many times this, , assumption is diffi d” 


ult to make. 


‘ 
a For example, is it reasgnable ‘to assyme- that decisions made from data gathered 
cy from a graduat ing tlass ‘one, three {and five years 1 ter will be the same as 
: *, dgeisions made if the same data are gathered from djfferent groups of graduates 
one, “three, and five years later? Differeacés betWRen the one, three, and f¥ve 
year data in the first case can be attributed to changes that occurred over’ 
time. Differences ‘between the one, three, and five year data in the§ second ' case . 
“may be attributed to differences in the groups of individuals from which the ~ + 
data were gathered (one, three,/and five year graduatost: -and/Or changes that _ 
may have occurred over time. ¥° ' tL 
— res a a 
As can be seen-from the ‘examplesfabove, both the longitudinal ‘and cross-sectional 
evaluation designs tuke into account ghange over a period of|time. They are 
‘viewed as development,evaluation designs, becaGse they #xamine-the development, 


* 


4 of somé situation over time. Both of these types of studies can be contrasted 
. . , With "one-shot" evaluation, That type of study is the one most often used by = 
: ’ Neg : 
i. 
ws : . oe 
jit afi 
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vocational educators in. “conduct ing follow-ups ‘and ‘other descriptive studies, 
The yraduates of the horticulture program would be followed up one year after 
graduation and the results described without examining what happened to these 
—_—-" individuals. over different periods of time. Another example a onan ok a ~ 
and reporting the: number of people entering. a program. i , » 
a —“ a 
a Both the longitudinal and cross-sectional designs have ‘limited: uses in evalus 
ating vocational éducation when dsed in their pure forms. They are primarily 
. désigned to examine individuals, programs, or other phenomena to determine 
development dr lack of devé lopment over time, Used in this way, their primary 


use would be’ to answer questions. like the following: 
8 : 7 be ‘ , * 
i = * 5 fi . * = r 
1. What changes occur in the employment: situations of graduates 
* as they develop their careers? . : F. 


: “2. What factors influence student choicés as they mature? 
3. How do the skill levels of stydents change ape anCESseed 
x ©, amounts. of instruction? as 


‘These yuestions represent: the many types of questions that need to be asked ins 
order to evaluate and improve vocational programming. 


Ld é * 
Pt) tages 


boo, Other primary concerns of vocational educators are to determine the relative 
efficiency or comparable performance of programs, or to identify factérs Y 
leading to success of students. Therefore ; this paper addresses long: tudinal 
methods - -from a much broader perspective than that: of a pure’ longitudinal evalua- 
tion, —*.. { —_ . 


\ - é 
Longitudinal methods are treated Jhere as tools ‘that would be useful in gath- 
ering information from the same individuals or programs over time without the * 
restriction that the information must be gathered with the same instrument or 
be ¢qmparable information. Longitudinal methods in this paper are viewed as 
ac vein the develbpment and analysis of a,data base over time that pertains 
f ‘to a given, individual, class, program, ras or other unit that one wishes 


, 


7 to evaluate. The use of this definition allows. for the examination of rela- 
tionships between different types of ‘information that' can be gathered. about 
a af eset individual or ‘program, ‘For aga a decision maker might be 
ing a scererinial program prior “to “taking. part in the vocational program and 
their employment supervisors! ratings of performance after they graduate from 
the program. In order to address this question, it would be necessary to 
gather the clerical aptitude information from individuals before‘they enter 
_the program and to gather «the supervisor evaluations: after graduation. Although 

. “these: two types of infor#t ion are quite different,, in order to study the rela- 

tionship between them, it would be necessary to gather information from the 
_Same individual at varying pornts in time. Lo , 


# ee 


a 
eo: 


f 


. % a 
An ERIC search was conducted to identify studies which used longitudinal meth- 


ods. The abstracts of many studies were reviewed. Only eighteen studiés could 


tionships between different types of data such as what factors might be related - 
to dropping out of a program as contrasted with successful completion of “‘h pro- 
gram. . : 
. * ‘ ‘ * ' 
Another study which ,coflected truly longitudinal data for three consecutive 
years was Project ‘LONG TEP (The Longitudinal Study of Educational Practices) 
which attempted to evaluate different developmental projects aimed at increas- 
ing language and math skills. Coles and qssociates (1976) stated that ''The 
general emphasis:of Project LONGSTEP. was on the identification of changes in 
gtudent achievemént that occurred as a result-of intensive educdtional innova-- 
tion” (p. vi). It was designed to rélate four basic categories of data: home. 
background, initial’ achievement status, educational treatment,. and teacher 
characteristics, to posttest performance. ‘Although the study .gathered some - 
of the data from the same individuals over a period of time, the data were not 
used as much to look.at changes over ‘time as‘to determine relationships between 
. types of data using correlation and regression techniques. 
‘The two preyious studies were the only two identifidd which minitally conformed 
in part to the strjct definition of a longitudinal study. The other studies 
identified in ‘theAiterature as referred longitudinal studies used the more 
Liberal defipitifn discussed (earlier. ¢ 


(Parnes et al., 1971). The study was designed to gather data on four subsets of 
‘the population: men forty-five to fifty-nine years of age, women thirty to. forty- 
four -years of age, young men fourteen to twenty-four years of age,~and young wo- 
men fourteen to twenty-four y@#rs of age. The data were then analyzed for each 
group in an attempt to identify characteristics that appear to be important in 
explaining vdriations in labor market experience. ‘ ) 

Pas — ae? ii 
Another example of such a study is the Nurse Career Pattern Study (Knopf, 1975). 
The data were. gathered from people .who centered schools preparing registered 
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*S araad a 1962, 1965, and 1967, The rationale for selecting Agngi tudinal meth- 
ods was similar to the underlying rationale used by many resedrchers. Knopf 
" (1975) found that "it was expected that through following and surveying the 


same cohorts over ‘a besten of years. a better picture of Tursing student § _and » 
Collect ing ‘in fdynation on the same: individuals over a period of. time shininated 
the need to assume that the people from’ whom‘the information was gathered were 
similar. They were not only similar, they were identical. Rarely can’one go. 


-back ‘to historical data stored in existing records to identify all of the infor- 


mation needed to classify Be pase enue into groups for ag apap In oe ee 
criterion data ¢an be gathered to compare grpups, Data can also be: gathéred ‘ 
which allow the members of the population being studied to be subdivided: into 
samples for the. sttdy of questions of interest, For example, in the case of 
of the Nurse- Career Pattern Study, biographical data were gathered on the Sty- 
dents as they progressed through the program, Later, when it wAs determined 
which students graduated and which studets withdrew, the two groups could be- 


compared on the originl biographical daa, Using» data such as these, it, would 


then to “determine how many of euch: ‘group withdrew: or Sense out at a TARE date. 
A similar rationale was ,ncorporated ‘into a six- year study “of potential, counsel - 
ing aids for vocational students at the postsecondary}, level. Project MINISCORE 
was conducted in thé state- of Minnesota over a perid&d of S1Xx years and funded 

by the U.S. Office of Education (Nelson and Pucel; 1972). “A data base, includ- 
ing biographical information and test information upon applicationg was deyel- 
dped on approximately 15,000 students who applied for admission to the -area 
vocational-technical schools of Minnesota. These individuals were then’ followed 
through their educational programs to determine which students were admitted or. 
not admitted and which students successfully graduated or withdrew from programs, 
One year after,graduation, ‘those people who graduated and their employers were 


followed up on the job, It was, then possible to study the relationships between 


the test data’ and other- charactéyistics of students upon application and their 


- success’rates after complet ing programs. ® In addition, because the data base 


existed, numerous studies‘ of interest. to vocational educators in Minnesota were, 
conducted, © : 


Studies such as the Career Thresholds Study, the.Nurse Career Pattern Study, and . 
Project MINISCORF seem to be the most useful applications of the longitudinal 
method to vocational education, It does not appear practical to restrict use 


of Yongitudinal “methods: to those studiés that gather the same information on 


w 


‘.the same group of individuals using the same instruments Over a peed of time. 
A broader perspective would be to gather-information of ‘interest 
- individuals over time whether or not it is necessarily the ident.agal information 


Kom the same 
and then to examine relationships meng those data.’ ¢ f 


tn addition to the atudies reported Neve, there are au number of classic longi- ° 
tudinal studies which should be meitioned because they do. provide information on 
techniques which may be applicable to. study ing vocational education, The major 
goal of these studies was to uncover tTelationships between the, characteristics 
and histories of pePR te and their Pera e ve TEOMe nl x 
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as” 
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ERIC 
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One of Piha earliest studies was - begun ‘ip-g21 nye ‘Ley 


Oden,’ 1948). The-'study gathered data) ol ‘1, 400 gifts 
_ gathered follow-up data ‘om these same’ children in 1 
‘“This study was aimed’ at being able to better underst 
sifte d children... 

th 1 57,. Donald E: Super ‘and’ | his associates saccethe 
search “eqndiicted dpring the Career Pattern Study (Si 


. Study, gathered longitudinal information felated to v 


group of ninth grade boys from the time they were fo 
- they ‘were thirty-five. The basic purpose | was .to und 
of. vocational development. er : 


Another well-known classic longitudinal Study was. Pr 
Cooley, 1966). This study was primarily concerned w 
career development.“of American youth. Information w 


*. sample of 400,000 ninth through ‘twelfth grade studen 


“of educational - -psychological tests and inventories. 
sought between these data on the SEUnEnES and Aheir 
havior after high school, 


VOCATIONAL EDUCATION DATA AND‘ 
LONGITUDINAL METHODS ae ae . e 
In the final snateuts, it appears ‘hat the basic pury 
is ‘to provide educational programs that will assist 
ment of employment related-skills and attitudes. The 
of,any vocationdl education evaluation system must br 
grams have the desired impact on students, Consequer 
grams become the central focus of data gathering. Ds 
ine relationships between “Student characteristics anc 


' teristics of the pfogram. In this way it becomes po: 


of program practices bring about ‘the desired outcomes 
i 
. 
_ Longitudinal methods hendae important in’ the study of 
vocational program practices and student development. 
the relationships between. students and programs unles 
on the same Students , ind programs over time. 


It is theoretical ly possible to set ‘up experimental d 
mental and control groups and to- random] y. assign ‘stud 
practices which do not require longitudinal data. Ho 
rarely possible. * It ®ould not make sense for a vocat 
students to'programs at random,‘ a&d it costs money te 
from control groups that are not “actually, Bae ee 


It is also possible to ‘idénti fy groups of student's an 

or thought earlier and to relate that to theér presen 

People employed:-in unrelated occupat Pons after’ grdua 
? “oF 
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‘and asked. what their occupational youl upon entering the program was in order to 


determine if the oecupations they entered are the ones they desired. At the same~ 
time. the ‘resuits of such questioning are not.always yccurate. ‘Looking back 1H 
not give. the. sume results as would have heen obtaihed if students were, asked that _ 
question ‘when - ‘they ‘entered “the, program, Students might try to rationalize tne 
occupations they actually entered by saying they. are the ones they originally 
wished to enter even though they priginally’ « did not feel shat way. 

. ™, ? 


might not Be obtainable, For example, if one were baterested Aare aa scl tore 
cal skills welders gained from a program, it would not be- possible to determine 


how much skill they had when’ they entered a program if that data were not col- 


lected at the time of entry. . 


Gathering and storing longitudinal data in ways that allow them to be identified 
with a particular student allows for the use of methods that eliminate these and 
other problems. However, other problems do arise. For instance, if students are 
hot. assigned randomly to programs and educational practices, it is not possible to 
tatk about causal relationships. Although this is a limitation, it still is possi- 
ble to uae correlational and other statistical techniques to caumine relationships. 


The storage of the data and the development of a continuing student or program 
record over time is anothersproblem of longitudinal data, If the longitudinal 
data are to be useful, they must be stored in a composite record for each student 
and updated as more data become available oa that student or the program in which 
he or she is enrolled. For only if the relationship is established between a 
particular student and the student's program can the statistical and analytical 
procedures which make longitudinal methods “powerful tools be realized, 


IMPLEMENTING LONGITUDINAL METHODS 


“ * 
5 


As was pointed out eurlier, the primary “factor in implementing longitudinal meth- 
ods is the availability of data gathered on the same individuals and their pro- 
grams over a period of time, This allows for the investigation of relationships 
among information obtained on individuals and their programs as they progress 


through vocational programs, Currently, most vocational schools have the basic 
information necessary to create a longitudinal datu base available to them. How- 
ever, this information is stored in many different forms and locations. For 
exanp le, student application information is stored with those people who counet | 
and admit) students to the vocational school, Budyeting information is stored 
with the administrative offices. Student progress information is stored in files 
of transcripts. Placement and follow-up information is found in a variety of lo- 
cations depending upon whether instructors keep the information or it i gathered 
in a central source, Phe same condition also tends to exist with data collected 


by state and’ federal apeneles. 


The major problem in the application of flongitudiii) methods to the divestipat ion 
of vocational programs is that of gathering the information on individuals and 
their programs from many locations and converting it to a format allowing for the 
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investigatiot_of relatio onships. * Few people can obtain the data from this type 
of disjointed data ayevem to apply longitudinal methods. - 


What are same possible solutions? ‘The first s se in developing a,longitudinal | * 
data base is the development of a cross- referenc ng system that will allow in- 
par Peres relative to that student, 
and el ects, a particular program to be:referenced relative to 
that program. This would allow the application information on a student to be, 
readily related to the follow-up information gathered later. . Each program in 
a school would also contain identification information that would allow for sit- 
uations as relating costs-associated with a program to other information avail- 7 
able on that sume program. ‘The link between the information. on students and 
their programs would be simple. Part of the students' records would be the - 
program in which they are enrolled and that could be indicated by the program 
identification information, Afterwards, one system would be developed to iden- 
tify all of the information on a particular student and another to identify all 
information on a particular program, (A file organization system would allow 
investigators to enter different Ciles of information on programs, find infoy- 
mation on the same program, enter different files’of information .on the same 
student, and find information on the student. These systems stilt would be 
mechanical systems of physically filing’ records and then’ gathering information 
from records. Although this would be a substantial improvement over the cur- 
rent situation where it is virtually impossible to, cfoss-index various types 
of information on students or programs, it would still be cumbersome. 


F { 
The next phase of making the ‘system more sophisticated would .be to develop 
computerized storage system, The,first stage of this process is the conver- 
sion of all of the information to a numerical coding system for a computer. 
Students and programs are usually assigned identification numbers. Lach type 
of information to be stored is categorized and coded. For example, to identify 
the instructional styles of programs one would ask the question, "What are the 
various categories that might be used to describe the instructional style used 
in a program?" [f five steps are identified, they would cach be given a code 
number that can be stored in a computer. Although this “sounds simple, it is 
a very complicated procedure because it is not easy to find Systems, that per- 
mit thegdeseription of some of the processes that are used in education, Many =<.» 
times these systems must be: createc Some prototype coding systems have been 
developed for some of the variables. of interest to vocational education as 
people have begun to develop, management information systems in vocational edu- 
cation. Some example. systems are included in Project Basel ine (Lee, 1972), 
the Minnesota Vocationa!l Follow-Up System (Pucel, 1975), Gklahoma's management 
rstem, and the National Vocational Education Data System (VEDS) 
stanee Workshop Manual, 1978). 


— 
Me, 


information 
(VEDS | 


After the numerical datu codes ure created for the program and student. data, 
data on each program and student are stored in a computer or in some form of, 
storage that can be computer input. Computers can easily store and access all 
of the information on a particular individual and can proup that information 
together as long as the information available on a particular student or pro- 
gram has the same identification number on all records. Data stored in a com- 
puter becomes a readily aecessibte data base that can be used te examine rela- 
tionships among various types gf informat ron.. 
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To this point an_ideal system has been deseribed er npilienoneane iongicuaiias 
methods. Many administrators reel ‘that they do not need all of the information 
on all studengys in order to mect federal and state compliance reports er to pro- 
vide adequate descriptions of what is occurring within their schools, districts, 
or states. They argue that a_sampling approach can be used to gather the infor- ‘ 
mation which greatly reduces the amount of effort and resources’ needed to gather, 
analyze, and store the information. ‘This is a legitimate argument, but if the 
information system is wéll-planned, it should _be possible to sample a group of J 
people upon Admission to programs and then to utitize that same sample as they : 
progress through the vocational programs, including thé “postgraduation follow- 
up. Using this. approach, the information would still be gathéred_on samples, 
but all‘of the information would be gathered on the same samples, which would 
allow for studying interrelationships among the various tynes of information. 
The current approach used by most schools, districts, and states is to draw-a | 


‘ separate sample for cach type of information needed. It is easier to draw a 


sample from the group of people that are available at a particular point in 

time and then to report information on that group, than it is to try to keep 
track of information on a particular group of individuals over a long period 

of time. ‘ The latter approach requires keeping better records on individuals 

and determining what happens to each member of the original sample. Howeven, | 
if all of the various types of information required are gathered on the same ‘ 
sample, hongitudinal methods can be applied to those data, “ 


Some of the general types of statistical procedures that are used with jira 
dinal data should be mentioned. Data contained in a longitudinal data bas 
generally are analyzed using some form of régre ession or correlational anal ysid. 
That is,one reason for storing information in numerical code. Other techniques: 
can be used to examine differences between groups on the same types of infor-_ 
mation, but certain assumptions have to be made about the equivalenge of the . : 
groups that are to be compared, Rarely can vocational educators use random ; 
sampling procedures that underlie the assumptions for most between-group tests. 
However, with the types of information that can be included in a longitpdinal 
data base, one san attempt to obtain essentially equal groups by matching many 
characteristics of the groups te be studied. Many researchers feel that matched 
groups provide a reasonable basis for using teehniques such as analysis of vari- 
anee, chi-square analysis, and other between-group comparison techniques even 
though seme of the sampling assumptions are not met. 


BASIC DATA REQUIREMENTS 


What types of data should be gathered tor Longitudinal methods in evaluating 
vocational education?, Th primary. types of data should pertain to students 
and programs, In the review of the literature, an effort was made to identity 
those data elements that seemed to appear consistently amony various fol low- 


up and evaluation systems in vocational education. In order to identify a 


structure for the types of data, the literature was reviewed in terms of the 
classifications of. data provided in The Minnesota Vocational Follow-Up 5yst 


Rationale and Methods (Pucel, 1973). This document listed major categori 
data that might be useful to vocational educators in planning and evaluation. 
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‘the literature that were mot contained in those 
assification system Was expanded, The basic categories 


If data were identified 
classifications, the c 


of data elements are ‘présented in Table IT, "Basic Longitudinal Student and Pro- 


gram,Data.'"' They are \divided into cinee sae types of informagfon: (t) input, 
(2) ‘program process, and {3) output. 


4 
t 


Most of the data shown are .obtained from students as they progress through a 
vocational program. The only program characteristic information included is 
the description of the nature of the instructional: program actually being de- 
livered to students. There are additional program characteristic data that 
could be gathered concerning the planning and operation of thg total school 
which could be reread to an edoeruet tonal program. Examples include the type 
sources “availsbie for student admissions, or “the! hiring policies for staffing 
instructional programs. Such information has not-been included sincegit does 
not relate directly to the instrugtional interaction between the students and - 


of information that allow one to define the context wéthin which vocational 
pFograms are conducted, such as labor market demand and economic condition of 
the country, are not included, However, it should be. recagnized that any total 
information system should include these types of informati 


. 


Input Data 4 


f ‘ 
As shown in Tables I and II, input information includes both biographical and 
enrollment information. The primary purpose of this information is to describe 
the student population and to proyide data concerning the enrollment of stu- 
dents in vocational programs. 
These two types of information are usually .gathered t one off'two different 
points in time. If one is interested in the nature of.all applicants, the 
biographical information is gathered at the time of applicat‘ion, and enrollment 
information is gathered when those accepted enroll. Tf information is only de- 
sired on those who enroll, both types of information are gathered at enrol]- 
ment. There are a number of advantages,to gathering information on all appli- 
cants in a longitudinal system. For example, it makes it possible to compare 
those who are accepted with those who are not, or to identify applicants who 
were not accepted in order to compare later job success of those who took part. 
in vocational education with those who did not. 


Biographical Information 


Biographical data can be divided into four subcategories: (1) identification 
information, (2) categorical information, (3) history information, and (4) test 
information. [dentification information allows for the identification of a 
particular individual and also provides information which might be useful in 
identifying or 18cating that person in the future. As can be seen from Table 
I, this type of information generally includes ens such as Social Security 
number,. nume, permunknt address, telephone number, parent or guardian name, 
parent or guardian address, and parent or guardian telephone number, 
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'the program which is preparing studénts to enter the world of work. Also, types 
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rizing students<for future 
report ing to ‘state, fe ederal, ta docal | governments or for sampling for other « 
studies. For example, if a question arose concerning the differences crew 


the percentages of males and females who graduated versus those who withdrew 
ere 
male and which were female. In that. sifatafion, the essential piece of cate- 
gorical information would be the sex of the student. Some. types of, categorical | 
information are age, Sex, marital status, annual income ‘of household,- number of- 
people living in household, ethnic background, and types of handicaps. 


from a particular program, it would be necessary to know which, students 


History ‘information provides .information ag the background of the students. 
Generally, in vocational education these data elements relate to prior educa-~ 
tional and work history. This information can be used to determine what an 
individual has done fm the past that might be related to-future performance. 
When included in a longitudinai data base, it allows one to study questions , 
like, "Does prior work experience in®a vocational area have an effect on a 
person's success in vocational-education in that area?" 

Another major category of biographical in rmation pertains to, an individual's 
-instructional readiness to. enter vocatiorfal programs. This information is of- 
ten referred to as "test-data" since it is tsually gathered\with) formal assess- 
ment ‘instruments. However, the intent is ta determine instructional readiness. 
The major purpose for gathering this information is to assess an individual's 
potential for success in educational programming + It usually attempts to iden- 

tify interests, prior skill development in the drea of trafning, and basic 

scholastic achievement in areas such as reading, writing, and arithmetic. When 
included in a longitudinal data base, these data allow one to study questions 
like "What types of special needs support are needtd by students who enter pro- 
‘grams with. particular levels of instructional readiness?" anc "What is the Like® 
tihood of success in a particular vocational program of peopid who have various 
levels of basic learning skills?" , ; 


——\. Enrollment. Information 


oy aie information i's used to deseribe the program in which a student 
enrolls. [ft includes information such as whether an individual who app Lied 
for admission to a particular program was accepted, the program in which the 
person enrolled, and the program starting date. To a large extent the en- 
rollment information can also be considered categorical information because 

it is used to identify enrollment categories of entering students and appli- 
eants. When included in a longitydifal data base these data allow one to 
study questions like "Are there Aifferences in the vocational program successes 
of people who enter programs 3 different times of the year?" or "Do graduates 
of different programs experience different rates of success?" 


= 


’ The enrollment information in addition to- the’ biographical information allow 
for a description of the student upon entering the vocational program.; They 
permit the future identificrtion of samples of interest so that certain 
relationships can be studied gnd are useful in the preparation of federal, — - 
state, and local reports. \ ‘ 
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_A ees detailed jection ‘of Ahese characteristigs will-onabhe asmore de- 

eno tailed: ‘4nvest igation of what factors lead ta- successful programs. Examples of 

; these data include information on proféssional resources, capital expenditures; 
cyrriculum ervey DEOEE OM Content, Gnstructional activities and ‘materials, 


“When program’ eect eed is cnciuied in a  foneitudinar ‘data base! 
it is possiblé to study questions like “What type of curriculum style is MOSt yy 
effective in teaching a particular type of student in.a particular vocational 
sprogram?" r "What differences are there in the costs of assist ijig | a special , 
needs student through a vocational program as compared | with other’ stpdents?" - 


Output—Bata — _. 42 ate SS : } 
The third major citpe gory: of dips that- asia be anevuded ina longitudinal data 
base is output data. ~AS indicated , in Table LI, outyut data can be clasgified 
into three types; (1) termination duta, (2) initial placement data, and (3) 

_ follow-up datu. These, data are used to destribe haw. students” leave a program 

Ye ge und what happens to them after they leave. Output data have been gathered by 
‘Vocavional educators for many years to satisfy local,,state, and federal, re- 
quifements . However, few scho@ls have gathered it in a longitudinal manner 
so all three types,of data have not been gathered on ‘the same indzviduals ane 

therefore’ they “cannot ba related to one another. 


hs, 


*. 


ieaiidelen informatign describes gow an individual exits from a vocational pro- 
gram. ‘Those wit enrgll in vocational programs usually exit in one of three 
ways: (1) graduation; (2) withdrawal, or (3) completion. ‘of a training objective 
without raduating. Most vocational educators consider an individual as having 
completed a training objective when that persoh completes ‘a previously deter- 
mined set of goals without completing all of the requirements necessary for 
fradiget ion. One problem facing vocational educators when collecting termina- 
“tion information is setting up a clear set of rules for defining when an indivi- 
dual actually completes a training objective or withdraws. 


om 
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* When termination information is included in a longitudinal data base it allows 
one to study questions Like "Whit types of students tend to successfully grad- 
"uate from a vocational program?" ov "What types of curriculum styles lead to 
4 certain types of special needs Students successfully graduating from vocational 
* att D 
F, oo : ae . 
: .. Initial Placement Information 
Initial placement information includes a description of whether graduates of 
vocational programs were employed after graduation and whether they were employed 
in related oceupations, Recently some people have also begun to ine lude infor- , 
“nation on the length of time it takes a person*®to pain employment, part reularily 


related employment. Initigl placement data have been pathered ror many years 
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Co agi Termination Information . -_ 2 7 —. 


Fs tesa’ comp] ifance: ,. Foquirements for, tie funding of 

Ser Ane.» It es the major type of, information used to judge 

. syitecmer sesuaenes ace meet ing ‘a primary goal. of vocational, education, obtaining 

ee jobs in jtraining ‘rpfated-occupations. However, these data have been gathered 
basically as’ ‘descriptive: 'tone- ing information and have not been gathered or, 


stored withsthe idea. of analyzing the process of Vocational education leading.., 
to successful placement. Most vocational schgols” ‘Cannot currently relate the 
placement.or nonplacemént of students to other data’ which they previously an 
+ -gathered about a student and the program, + If Rlaceyent information “could be , 
~ related to other data, vocational’ eddgators could Study questions like "What . 
° educational program characteristics,4 d student charaéteristics of graduates 
ledd to high placement rates?" : — 


r 


‘Also, such informat ion has been largely restricte 4 to information gathered from 
graduates of vocadtyonal programs. ‘Thi's does not allow for a comparison of the 
affects of vocational education om the empoyment potential of individuals. In 
order ta study that problem, data must be gathered from applicants who were not 
enrolled in vocational programs as well as people who enrolled but did not, grad- 
: uate frog. the programs. The current inability to answer important questions 
~. . concerning vocational education from initial placement data suggests the impot- 
tance of ‘fts inclusion in a longitudinal data base so sinterreclationships can be 
studied. ’ 3 % 
: : wa 
5 Follow-Up Information , 


* 


Follow-up information is usually considered by focational educators to be 
information gathered on’ graduates of a programAt some point after they have 
left the program. Some educators consider inftial placement information to 
be follow- -up information, but for purposes of this paper it is treated sepa- 

rately. Follow-up, as defined here, relates to gathering information from 
individdals after they have,had. time to develop a postgraduation work history 
of six months. an , 


Many types of follow-up data can be gathered and classified in numerous ways. 
In this paper the follow-lip data have been classified into four major types: 
(1) employment history, (2) current employment status, (3) graduate judgments 
of training program based on job experfence, and (4) employer evaluation of 
performance, These categories represent minor modifications of the classifi- 
cation system presented in The Minnesota Vocational Follow- Up System; Rationale 
) amd Method (Pucel, 1973, p. 53). That system is presented in "Possible Organi- 
zation of the Follow-Up Information’ Obtained frem Graduates and Their Employers" 
(see Table ITT) which indicktes the types of information that might be included 
in cach of the four major categories. To be most useful, th data should be 
included in a longitudinal data base. If the follow-up Pie Seek in 
a longitudinal data base they allow one to study Questions like "Whit types Of" 
program characteristics tend to lead to improved employer evaluations of un 
performance of program graduates?" 
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\ Based-on a.review of the, literature, it is apparent that ‘few vocational educa- 
tors have attempted to apply longitudinal methods in the past.’ However, longi-’ 
tudinal methods do appear. to be very. vuseful techniques in the ‘study of many of 


the questions currently being asked by. the ‘critics and the funders of -voca- 


tional programs. If longitudinal methods ‘are used appropriately, questions 
such as the f FODLOMIN may be. asked ; 2 - of ° 
1. Does vocational education make a difference?, : ae Nee 
. 2. What program practices increase the possible success oF ‘vocational 
7 graduates? = 
3, What are the additional costs of preparing special needs students? 
a s - 


weaetThese questions, as well us many othérs can be addressed a a straight forward 
manner. In addition, they can be used to develop longitudinal data bases whieh ; 
would provide the information for many of the state, federal, and local report's 
on vocational education. . 
: : i 
There are drawbacks to the use of these methods, however. The deve lopment: of 
a longitudinal “data base which could support .the use of, longitudinal methods | 
requires the gathering of information on the same individuals or progtams over 
« a period of time and the storage of that information. This sees ear ee 
' data gathering processes which are being used by vocational educators today.’ 
Most vocational’ educators currently conduct descriptive studies aimed at col- 
lecting information needed to meet reporting requirements, Little attempt is 
made to relate one type of information to another. However, even though the 
data gathering processes associated with longitudinal methods are more compli- 
cated than currently utilized procedures, a well-developed longitudinal system 
would facilitate the generation of data for vocational education decision mak- 
ing and reporting. - 
rated on a continual basis, the baste prob- 
he use of longitudinal methodologies 


If longitudinal dats buses were pene 
lem of length of time associated with 
would be eliminated. Tf the relevant Alata were gathered on a continual basis, 
p it would he possible to ask questiony and to investigate relationships using 
' data continually available in @ longitudinal Jata base rather than having. to 
—~\ Wait for an extended period of time to gather all of the necessary information, 
This would make it more feasible to address questions about relationships be- ~ . 
tween changes in vocational programs and effects on students, 


In order for vocational education schools,,school districts, or state depart- 

ments to utilfze longitudinal methods to full advantage, they will need proto- 
type systems which they can implement or nog ty: Although some of the tech- 

niques discussed in this paper can be implem@nted by educators familiar with 
the development of education dath systems, most education agencies do not 

have personnel! that could devedop those systems. However, with prototypes . 
many could be implemented with the assistance of local and statewide computing 


.o° systems. It is recommended that resources be made available to develop proto- 
os, type systems which can be quickly implemented by vocational education mstitu- 
: tions. : : : 
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